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Abstract 

We  present  a  high-speed  range-imaging  system  based  on  a  VLSI  computa¬ 
tional  sensor  developed  in  the  CMU  Computer  Science  Department.  The  VLSI 
range  sensor  is  a  custom  chip  consisting  of  an  array  of  cells  which  combine 
photo-sensing  and  computation.  Unlike  conventional  "step-and-repeat"  light- 
stripe  range  finders,  our  sensor  gathers  range  images  in  parallel  as  a  scene  is 
swept  by  a  continuously  moving  plane  of  light.  A  prototype  range-finding  system 
has  been  built  using  a  second-generation  sensor  and  is  capable  of  acquiring  a  32 
X  32  point  frame  of  3-D  measurements  in  a  millisecond  —  two  orders  of  magni¬ 
tude  faster  than  currently  available  range-finding  systems.  The  accuracy  and  the 
repeatability  of  the  acquired  range  data  has  been  measured  to  be  less  than  0.2%. 

In  this  paper,  we  discuss  the  range-finding  system  and  present  experimental 
results  that  measure  its  performance. 
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1.  Introduction 


Range-finding  is  a  key  component  for  many  robotic  applications.  Numerous  techniques 
have  been  developed  to  acquire  the  three  dimensional  profile  of  a  scene  as  a  range 
image[5].  Among  these,  light-stripe  range-finding  is  one  of  the  most  robust  and  practical 
methods.  A  conventional  light-stripe  range  fiiLiler  operates  in  a  step-and-repeat  manner. 
The  light-stripe,  a  plane  of  light,  is  projected  at  a  known  position,  and  an  intensity  imane  is 
taken  using  a  CCD  camera.  Then  the  position  of  the  stripe  in  the  image  is  extracted.  11  the 
camera  geometry  is  known,  range  information  of  the  points  lit  by  the  stripe  is  obtained  via 
triangulation.  To  acquire  a  complete  range  image  the  stripe  is  stepped  and  the  process  is 
repeated  until  entire  scene  has  been  scanned.  Usually  it  takes  on  the  order  of  a  second  to 
acquire  a  single  range  image.  Such  a  long  acquisition  time  has  restricted  the  use  of  this 
type  of  range  finder. 

We  developed  two  generations  of  cell-parallel  light-stripe  sensors,  taking  advantage  of 
recent  VLSI  technoiogy[  1,2,3]  to  process  the  monitored  intensity  signal  at  each  sensing 
element.  As  the  light-stripe  sweeps  continuously  over  the  scene,  each  element  measures 
the  time  at  which  it  sees  the  peak  intensity  reflected  from  a  point  on  an  object  surface.  As 
the  stripe  position  is  controlled  precisely,  the  measured  time  is  converted  to  the  stripe  posi¬ 
tion,  which  is  u.sed  to  determine  the  point  in  three-dimensional  space  where  the  object,  the 
stripe  and  the  sensing  element  line-of-sight  ray  intersect.  In  this  method,  the  acquisition 
time  is  determined  by  time  required  for  the  stripe  to  sweep  the  scene,  limited  by  the  bund- 
v/idth  of  the  photoreceptor  used  in  the  element.  Arranging  these  sensing  elements  in  a 
two-dimensional  array,  a  range  image  can  be  acquired  very  rapidly.  All  sensing  elements 
operate  in  parallel  so  that  acquisition  time  does  not  depend  on  number  of  measuring 
points. 

We  incorporated  the  VLSI  range  sensors  into  a  prototype  range-imaging  systemjdj. 
This  system  consists  of  a  sensor  chip  and  its  interface  electronics,  a  light-stripe  generating 
assembly,  and  a  three  degree-of-freedorn  (3-DOF)  positioning  system.  We  also  tieveloped 
a  new  calibration  algorithm  which  maps  the  measured  range  data  into  the  world  coordi¬ 
nate  system. 

In  Section  2.  we  present  the  cell-parallel  algorithm  which  we  employ  and  m  Section  3 
review  its  VLSI  implementation.  In  Section  4,  we  de.scribe  the  configuration  of  the  proto¬ 
type  range-imaging  system  which  we  have  (.levclopcd.  System  calibration  is  presented  in 
Section  5.  and.  in  Section  fi.  we  show  experimental  results  and  summari/.e  the  range  sys¬ 
tem  performance. 
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1.  Introduction 
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2.  Cell-Parallel  Light-Stripe  Range  Imaging 


Figure  2.  Cell-parallel  light-stripe  range  imaging. 


2.1.  The  Cell-Parallel  Method 


The  cell-parallel  technique,  in  which  photoreception  and  signal  processing  are  per¬ 
formed  in  each  sensing  element,  is  a  better  approach  for  light-stripe  range-tindinglb].  Fig¬ 
ure  2  shows  how  a  cell-parallel  light-stripe  range  finder  operates.  In  this  figure,  three 
sensors  arranged  in  a  line  are  shown.  The  light-stripe  is  perpendicular  to  the  page  and 
swept  across  the  scene  from  right  to  left.  Each  sensor  measures  the  lime  at  which  the  stripe 
is  seen  along  its  line-of-sight  ray.  For  instance,  cell  S2  monitors  the  light  intensity  I2 
returned  along  its  line-of-sight  ray  R2.  The  intensity  peaks  when  the  stripe  crosses  a  point 
at  which  the  line-of-sight  ray  intersects  the  object  surface.  If  the  projection  angle  B]  It2)  is 
controlled  precisely,  range  is  a  function  of  time  t2  Cell  S2  performs  peak  detection  on  the 
measured  intensitv  and  reports  the  lime-sicmip  t2  at  which  the  peak  occurred.  The  three- 
dimensic  .1  coordinate'  of  the  object  point  are  uniquely  determined  from  the  time-stamp 
as  the  inu  .  section  of  th^  ine-of-sight  R2  with  the  stripe  plane  at  B|  (t2)  on  the  surface  of 
the  object, 

A  sensor  which  acquires  a  range  image  can  be  built  by  arranging  sensing  cells  in  a  two- 
dimensional  array.  The  cells  work  in  parallel  during  a  single  pass  of  the  stripe  over  the 
scene.  Therefore,  acquisition  time  is  independent  of  the  spatial  resolution  — 

_  j-Sn  tpc  , 

W  -  // 

The  acquisition  time  '/'j'"''"'  of  a  cell-parallel  .sensor  is  determined  by  the  bandwidth  of  the 
photoreceptor  used  in  its  sensing  elements.  The  photoilit)des  usetl  in  our  cell  design  have  a 
bandwidth  on  the  order  of  iricgahert/.  So  very  high  frame  rates  (  1  /Tj '")  are  achie\ei.l. 
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Figure  3.  Range  sensor  integrated  circuit  (second  generation). 

3.  The  VLSI  Range  Sensor 

In  order  to  measure  range  using  a  very  high-speed  stripe,  the  interface  between  the  pho¬ 
toreceptor  and  signal-processing  circuitry  in  each  sensing  element  must  have  high  band¬ 
width.  A  computational  sensor  provides  a  local  high-bandwidth  connection  in  each 
element  of  what  can  be  a  large  sensing-clement  array.  Silicon  VLSI  technology  provides 
the  means  for  building  such  a  sensor. 

We  have  fabricated  two  generations  of  multi-pixel  cell-parallel  range  sensors.  In  the 
first-generation  chip,  thresholding  is  used  for  peak  detection  (Appendix  A).  The  second- 
generation  range  sensor,  shown  in  Figure  3,  incorporates  several  advantages  over  the  first- 
generation  design.  The  die  area  of  the  new  cell  is  216  pm  x  216  pm.  40'’;  smaller  than  that 
of  the  cells  of  the  first-generation  sensor  (photoreceptor  area  has  been  kept  constant). 
Stripe  detection  is  done  in  a  more  robust  manner  and  the  range  data  readout  circuitry  has 
been  simplified.  In  addition,  the  new  cell  provides  a  means  to  record  and  readout  the  peak 
intensity  seen  when  a  range-data  sample  is  acquired.  This  intensity  image  is  used  in  the 
system  calibration  process  as  described  in  a  Section  5. 1.  The  second-generation  sensor 
chip  has  1,024  range-sensing  elements  arranged  in  a  32  x  32  array. 

3.1.  Sensor  Implementation 

Figure  4  summarizes  the  operation  of  each  element  in  our  cell-parallel  sensor  array. 
The  incident  light  intensity  is  converted  into  a  voltage  signal  and  the  peak  of  this  wave¬ 
form  is  detected.  The  time  at  which  the  peak  occurred  (the  time-stamp)  is  recorded  in  a 
memory  element  within  the  cell.  This  time-stamp  is  later  read  out  of  each  element,  provid¬ 
ing  raw  range-image  measurements. 

Circuitry  found  m  each  sensing  cell  of  the  second  generation  chip  is  outlined  in  Figure 
5.  Shown  are  the  photoreceptor  {PDiode),  photocurrent  transimpedance  amplifier  {Photo- 
Amp},  peak  follower  iPeakHld),  comparison  stage  (Comp),  and  time-stamp  samplc-and- 
hold  iPGate). 
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3.  The  VLSI  Range  Sensor 
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Figure  4.  Basic  sensing  element  block  diagram. 


3.2.  Sensor  Operation 


In  operation,  the  sensing  cells  cycle  between  two  phases  —  acquisition  and  readout. 
During  the  acquisition  phase,  the  light  intensity  from  the  stripe  reflected  back  from  the 
object  is  monitored.  Photocurrent  output  is  amplified  and  fed  to  the  input  of  the  peak-fol¬ 
lowing  circuit,  recording  (Vf  on  capacitor  C,)  the  maximum  light  intensity  observed  dur¬ 
ing  this  stripe  scan.  When  the  intensity  peaks,  the  value  of  the  time-stamp  voltage  is  held, 
recording  the  time  of  the  stripe  detection  (Vt^  on  C9). 

The  acquisition  phase  ends  when  the  stripe  completes  its  scan.  At  that  time,  the  cells 
have  recorded  a  range  image  in  the  form  of  held  time-stamp  values,  as  an  analog  voltages 
stored  on  the  capacitors  found  in  each  cell. 

The  readout  phase  immediately  tollows  the  acquisition  phase.  The  raw  range  data  is 
read  from  the  chip  in  time-multiplexed  fashion.  Charge  held  in  each  cell  is  gated  through 
pass  transistors  and  integrated  using  an  on-chip  amplifier  to  produce  a  buttered  output 
voltage.  Cells  are  addressed  for  readout  using  row  and  column  sJcct  lines.  An  NxM 
array  is  read  using  N  row  enables  lines  and  M  column  enables.  A  given  cell  is  read  by 
as.serting  the  row  and  column  enables  that  correspond  to  its  location  in  the  array. 


3.  The  VLSI  Range  Sensor 


I  iolire  6.  The  cell-paritllel  ninue-lindiii}-  system. 


4.  The  Ranj»e-Ima^in^  System 
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I  able  1.  (  ell-piirallel  sensor  system  sumniar\. 
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4,  The  Range-Imaging  System 


Figure  7.  Scan  detectors  for  system  synchronization. 
4.1.  Scan  Generation 


The  scar-generation  assembly  emits  a  plane  of  light  and  scans  it  over  the  scene.  A  laser 
diode,  which  emits  near-infrared  (780  nni)  beam,  is  used  as  the  light  source.  The  beam 
from  the  diode  is  first  collimated  and  then  fanned  into  the  stripe  using  a  cylindrical  lens. 
The  stripe  is  swept  using  a  mirror  attached  to  a  s'pinning  motor.  Sensing  elements  obtain 
range  information  by  measuring  the  time  at  which  each  secs  the  projected  stripe.  Thus,  the 
position  of  the  light-stripe  as  a  function  of  time  must  be  controlled  precisely. 

As  shown  Figure  7.  two  photo  sensors.  SO  and  SI.  measure  stripe  geometry.  One  pro¬ 
vides  a  start-of-scan  (SOS)  (time  origin)  signal  and  the  other  an  cnd-of-scan  (EOS)  (dura¬ 
tion)  signal.  (For  Icft-to-right  scans.  SO  measures  SOS  and  SI  measures  EOS.)  SO  and  SI 
are  located  at  a  fixed  angle  of  =  40°  around  the  axis  of  rotation  of  the  motor.  The 
system  records  the  time,  t^os  ^EOS’  when  each  detector  sees  the  stripe.  The  angular 

velocity  of  the  motor  is  constant  and  .so  stripe  position  Bp  ( 7)  is  — 


e,(o  = 
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\  < 


^SOS^  “  -(1)^,  (/  t 
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The  time  between  SOS  and  EOS  is  measured  precisely  for  each  range  measurement.  The 
result  is  u.sed  to  adjust  the  time-stamp  data  read  from  the  sensor  to  compensate  for  varia¬ 
tions  in  the  speed  of  the  stripe-scanning  motor. 

The  angular  velocity  required  for  the  motor  to  achieve  a  scan-time  ot  is  — 


i 
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4,2.  Sensor  Interface 
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^  ^  1  1 
^  2  •  360°  ■  Tscan 

The  factor  of  1  /2  appears  because  the  reflected  stripe  swept  two  degrees  for  every  one 
degree  of  motor  rotation.  Assuming  =  40°  and  =  I  ms,  angular  velocity 

=  3,  300  rpm  is  required.  If  a  single -faceted  mirror  is  used,  the  frame  rate  is  only  60 
Hz  even  though  the  acquisition  speed  is  high.  A  polygonal  mirror  is  one  mechanism  for 
increasing  the  frame  rate,  Oui  system  uses  another  mechanism  —  a  single-faceted  mirror 
mounted  on  a  galvanometer.  The  galvanometer  is  driv^en  by  a  triangular  wave  provided 
from  an  external  signal  generator,  A  galvanometer- based  sweep  mechanism  produces  left- 
to-right  and  right-to-left  .scans.  Both  are  used  for  range  measurement.  The  relative  timing 
of  the  SOS  and  EOS  signals  identify  the  direction  of  a  given  scan.  By  choosing  the  trian¬ 
gle  wave  frequency  and  the  mirror  excursion  carefully,  a  high  range  frame  rate  is  achieved 
while  maintaining  the  one  millisecond  sca. 


4.2.  Sensor  Interface 

High-accuracy  range  measurements  at  high  frame  rates  necessitates  specialized  inter¬ 
face  electronics  for  the  sensor  chip.  As  described  in  Section  2.2.  each  sensing  element 
records  range  as  a  time-stamp  voltage  held  on  a  capacitor.  During  the  acquisition  phase, 
the  time  signal,  a  voltage  ramp  broadcast  to  each  clement,  must  be  precisely  synchronized 
with  the  stripe  scan.  Also,  the  held  time-stamp  voltage  must  be  read  out  quickly  to  mini¬ 
mize  errors  due  to  charge  leakage.  Finally,  a  .system  flexible  enough  to  be  u.sed  with  the 
first-generation  .sensor,  as  well  as  future  sen.sor  designs,  without  major  modification  was 
required. 

To  address  these  needs,  wc  developed  interface  electronics  based  on  a  microcoded 
engine.  This  interface  permits  high-accuracy  operation  of  the  device  at  high  speed.  Wc 
achieved  a  range  accuracy  of  0.5  mm  using  one  millisecond  stripe  scans  using  it.  In  addi¬ 
tion.  the  interface  supports  readout  of  the  intensity  images  piovided  by  the  second-genera¬ 
tion  chip  and  row/column  based  readout. 

As  shown  in  Figure  8,  the  chip  interface  consists  of  two  boards  —  the  master  hoard  and 
the  slave  hoard.  The  master  board,  which  is  installed  in  the  host  computer,  controls  the 
system  operation  and  communicates  with  the  host  computer.  The  microcoded  engine  ciui- 
sists  of  a  memory  and  a  program  counter,  which  is  driven  by  an  8  MHz  clock.  Interlace 
operations  arc  programmed  using  microcode.  This  structure  prervides  very  fast  operation 
and  accurate  time  management,  A  memory  is  provided  for  data  storage  which  enables  the 
system  to  acquire  up  to  5 1 1  range  image  frames  continuously  without  host  interacting  with 
the  host. 

The  sensor  chip  and  its  optics  are  mounted  on  the  slave  board.  Two  12-bit  anah'g-lo- 
digital  (A/D)  converters  and  two  12-bit  digital-to-unalog  (D/A)  converters  are  incorpo¬ 
rated  on  this  board.  The  signals  from  the  scan  detectors.  SO  and  SI.  are  processed  with 
logic  found  here  to  obtain  the  SOS  and  EOS  signals.  .Sensor  chips  with  ditlcrent  pin 
assignments  are  easily  supported  by  rewrapping  short  wires. 

The  master  and  slave  boards  arc  connected  by  10-bit  half-duplex  parallel  bu.ses,  which 
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Figure  8,  Chip-interface  block  diagram. 
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can  transfer  data  at  10  Megabytes  per  second.  I’sing  this  circuitry,  all  1.024  sensor  cells 
are  read  in  approximately  3.5  msec,  with  the  on-chip  integration!  1  ]  and  the  /\/D  conver¬ 
sion  dominating  the  readout  time. 


5.  Calibration 


Calibration  provides  the  complete  specification  of  system  geometry  necessary  for  con¬ 
verting  cell  time-stamp  data  into  range  data.  The  calibration  parameters  consist  of  two 
models.  The  first  is  the  imager  model,  which  describes  the  geometry  and  optical  parame¬ 
ters  of  the  sensor  chip.  The  second  is  the  stripe  model,  which  maps  time-stamp  values  to 
distance  for  all  sensing  elements. 

5.1.  Imager-Model  Calibration 

The  imager  model  takes  the  form  of  a  4  x  3  projection  matrix  C  which  maps  three- 
dimensional  points  (.V,  y,  c)  onto  two-dimensional  sensor-image  plane  points  (n.  v)[7]. 
This  projection  is  written  as  — 

•*C||+.VC2|+JC3|+Cj| 

It  —  - 

.tc  +  vc..,^  +  -f 

and 

.VC  p  +  y^22  “"^32  ^42 

I  ^  +  V^23  '"^33  ^43 

where  are  the  components  of  matrix  C.  Practically.  Cj,  is  set  to  one.  leaving  eleven 
parameters  to  be  solved  for  in  this  step.  As  sensing  cells  are  arranged  in  square  grid,  the 
rows  and  columns  of  the  array  are  interpreted  as  coordinates  in  the  image  plane.  To  per¬ 
form  the  imager  model  calibration,  a  data  set  consisting  of  {.v.  y.  ■)  and  (//.  v)  is  col¬ 
lected  over  the  entire  field  of  view  using  a  planar  reference  object  manipulated  with  the 
accurate  3-DOF  positioning  device  built  into  the  range  system.  From  the  measurements, 
parameters  of  C  are  determined  using  a  Ica.st  squared-error  fitting. 

Intensity  images  from  the  second-generation  .sensor  arc  used  to  measure  ( ti.  v)  .  (The 
intensity  data  was  measured  to  be  reliable  enough  (see  Section  6.2)  to  be  used  for  the 
imager-model  calibration.)  To  collect  the  data,  a  white  planar  target,  on  whieh  a  black  tlot 
of  3  cm  diameter  has  been  drawn,  is  used  as  shown  in  Figure  9.  The  target  is  mounted  on 
the  positioner  so  that  its  surface  is  parallel  to  the  world-.vy  plane.  An  intensity  image  is 
taken  for  each  target  position.  The  centroid  of  the  dot  in  the  image  plane  is  calculated  after 
thresholding  the  image  to  a  binary  image.  Figure  10  shows  the  centroid  detection  result 
when  the  target  is  moved  along  the  .Y,,  or  axes  at  a  given  Z,, .  The  dashed  line  in  the 
plot  shows  a  itted  line  which  represents  the  real  position  of  the  mark.  The  accuracy  ol  the 
centroid  detection  (i.e  —  the  error  from  the  fitted  line)  was  ealculated  to  be  within  0. 1  pix¬ 
els  in  the  u  and  v  directions.  The  standard  deviation  was  less  than  0.05  pixels.  These 
results  show  that  data  collection  using  the  intensity  images  provided  by  the  second-gener¬ 
ation  sensor  yield  accurate  and  stable  data  sets  for  imager-model  calibration. 

In  order  to  incorporate  measured  imager-mode!  data,  equations  (5)  and  (6)  are  written 
in  matrix  form  as  follows  — 


(5) 


(6) 
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5.1.  Imager-Model  Calibration 
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.Viv  ImmI 

Figure  11.  Imager-model  calibration  result  at  =  0. 


where  in'.v')  i.s  the  eentrtnd  detected  for  the /-th  target  position  (  v'.  y'.  :')  and /ms  the 
total  number  of  measured  points.  If  more  than  six  points  are  u.scd.  the  eleven  calibration 
parameters  arc  determined  using  a  pseudo-inverse  method  (Appendix.  C). 

To  evaluate  the  imager  model  obtained,  we  calculated  the  target  position  in  world 
coordinates  by  substituting  measured  centroid  position  (//'.  v')  and  into  equations  (5) 
and  (6)  and  compared  the  computed  result  with  measured  centroids.  Figure  1 1  shows  the 
accuracy  of  the  imager  model  at  Z^^,  =  0  mm.  A  indicates  the  actual  target  position 
{x',  y')  and  “0"  shows  the  predicted  position  —  a  plot  of  (//',  v')  obtained  via  imager- 
model  calibration.  The  averaged  restoration  error  is  0.5  mm,  roughly  0.1%  of  range,  ade¬ 
quate  for  the  desired  0. 1  %  range  measurement  accuracy. 

The  imager-model  geometry  is  now  fully  specified  through  calibration. 
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Figure  12.  Stripe-model  calibration. 


5.2.  Stripe-Model  Calibration 

The  second  part  of  the  calibration  procedure  determines  the  stripe-model  a  mapping 
between  time-stamp  data  and  range  along  the  line-ot-sight  ray  ot  every  sensing  clement. 
As  shown  in  Figure  1 2.  a  planar  white  target  is  used  to  pcriorm  the  calibration.  The  taiget 
is  held  at  a  known  world-r.  position,  parallel  to  the  .vv  plane,  and  time-stamp  leadings 
from  all  sensors  are  recorded.  This  process  is  repeated  lor  many  positions.  I  sing  this 
information,  the  function  which  maps  the  lime-stamp  value  B,^.  read  Irom  a  given  cell  into 
the  distance  x  along  the  cell's  line-ot-sight  is  approximated  via  a  parabolic  lit.  A  system 
that  scans  the  light  stripe  in  two  directions  ( lell-lo-righl  scan  and  righl-to-lell)  needs  two 
sets  of  parameters  for  each  cell.  During  range  measurement,  the  direction  ol  each  scan  is 
recorded  in  order  to  specify  the  parameter  set  to  be  used  lor  the  range  conversion.  Fxperi- 
rnenlal  data,  showing  the  filled  T  versus  B,^  functions  for  several  sensing  elements,  is 
shown  in  Figure  1 3. 

Calibration  of  the  cell-parallel  range  .sensor  is  now  complete. 
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5.2.  Stripe-Model  Calibration 


Figure  13.  Stripe-model  calibration  result. 
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Figure  14.  Cell  (15,  15)  range-data  histograms. 


6.  System  Performance 


6.1.  Range  Accuracy  and  Repeatability 


The  quality  of  the  range  data  produced  by  the  cell-parallel  range  sensor  was  evaluated. 
In  this  measurement,  a  plantir  target  was  held  at  a  known  world--  position  with  the  3-DOF 
positioning  device.  The  world-r  axis  heads  almost  directly  toward  the  sensor  with  :vv’  = 
300  mm  roughly  away.  Analog  time-stamp  values  from  the  sensor  array  were  digitized, 
using  a  12-bit  analog-to-digital  converter  (A/D),  and  recorded  tor  1 .()()()  trials.  Light-stripe 
sweep  (acquisition  pha.se)  time  for  each  scan  was  6  msec  and  the  frame  rate  was  100  Hz 
(includes  4  m.sec/frame  readout  time). 

A  histogram  of  the  range  data  reported  by  one  cell  is  plotted  in  Figure  14.  The  horizon¬ 
tal  axis  represents  the  digitized  time-stamp  value,  converted  to  woiid-r  distance  through 
the  calibration  model.  Data  for  six  world--  positions  are  combined  in  this  plot.  The  verti¬ 
cal  axis  shows  the  number  of  times  (plotted  logarithmically)  out  of  the  1.000  trials  that  the 
sensing  element  reported  that  world-,:  distance.  The  sharpness  of  each  peak  is  an  indica¬ 
tion  of  the  stability  (repeatability)  of  the  range  measurements. 

Averaged  statistieal  data  for  all  sensing  elements  is  plotted  in  Figure  15.  In  order  to 
measure  accuraey  and  repeatability,  the  position  of  the  target,  as  reported  by  the  cell-paral- 


21 


22 


6.  System  Performance 


((.0  I - 1 - 1 - 1 - 1 - 1 - 1 - 1 

0  20  40  60  HO  KM)  120  140 

Zw(mm) 

Figure  15.  Range  data  accuracy  and  repeatability. 

lei  sensor,  is  compared  to  the  actual  target  r  position.  The  “boxed”  points  in  the  plot  repre¬ 
sent  the  mean  ab.solute  error,  expres.sed  as  a  fraction  of  the  world-r  position  and  averaged 
for  all  elements  ut  Zw.  One  standard  deviation  of  “spread”,  also  normalized  with  Zw,  is 
shown  above  aa.l  below  each  box. 

The  experiments  show  the  mean  measured  range  value  to  be  within  1  mm  at  the  maxi¬ 
mum  500  mm  c  —  an  accuracy  of  0.2%,  The  aggregate  distance  discrepancy  between 
world  and  measured  range  value  remains  less  than  1  mm  over  the  entire  360  mm  to  500 
mm  c  range.  The  cell-parallel  sensor  repeatability  is  found  by  computing  the  standard 
deviation  of  the  distance  measurements.  The  measured  repeatability  of  histogram  data  is 
le.ss  than  0.5  mm  —  0, 1  %  of  the  maximum  500  mm  positioner  translation. 


6.2.  Measurement  of  Scene  Reflectance 


As  shown  in  .Section  3. 1,  intensity  data  is  acc|uired  by  the  second-generation  cells.  This 
sensor  directly  measures  scene  rellectance  as  an  artifact  of  the  ranging  process  and  is 
unlike  intensity  information  returned  liy,  for  example,  a  CCD  camera.  In  order  to  extract 
stripe  timing,  the  peak  intensity  value  observed  during  the  stripe  scan  is  recorded.  The  sec¬ 
ond-generation  sensing  cell  provide  the  means  to  read  these  values  from  the  chip.  The 
scene  is  swept  by  a  light  source  of  known  power  and  distance  to  the  target  object  is  mea¬ 
sured.  Thus,  scene  rellectance  can  be  extracted  from  the  peak  intensity  value  provided.  We 
use  these  '■pseudo-intensity"  images  in  the  system  calibration  process  (Seriion  5, 1 ). 


6.3.  Range-Image  Samples 
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Figure  16.  Intensity  histogram  at  cell  (15,  15). 

The  quality  of  the  peak-intensity  data  has  been  evaluated.  Figure  16  shows  a  histogram 
of  the  data  measured  by  one  cell.  In  this  experiment,  a  planar  target  was  placed  a  lixed  dis¬ 
tance  from  the  sensor,  roughly  parallel  to  the  world-.vv  plane.  One  thousand  frames  of 
intensity  data  were  acquired.  To  control  the  incident  intensity  level  from  the  stripe  projec¬ 
tor,  neutral-density  filters  with  known  transmittance  were  placed  between  the  stripe  light 
.source  and  the  target.  In  the  figure,  the  horizontal  axis  represents  the  intensity  value  (digi¬ 
tized  to  12-bit.s)  and  the  vertical  axis  shows  the  number  of  times  a  given  1 2-bit  value  was 
seen  out  of  the  1,000  trials.  Data  for  eight  filters  of  different  transmittance  (the  eight 
peaks)  are  combined  in  this  plot  (filter  transmittance  used  for  each  peak  is  labeled  "T”). 

The  incident  intensity  change  is  clearly  seen  in  Figure  16.  The  sharp  peaks  in  the  plot 
indicate  the  high  stability  of  detected  intensity.  The  standard  deviation  for  each  measure¬ 
ment  is  calculated  to  be  less  than  one  hit  (intensity-value  gain  used  for  the  experiment 
could  have  been  higher).  This  result  supports  the  reliability  of  system  calibration  done 
using  the  p.seudo-intensity  images  returned  by  the  chip. 

6.3.  Range-Imajje  Samples 


Figure  17  shows  a  range  image  acquired  by  the  sensor,  plotted  using  a  wire-frame  rep¬ 
resentation.  The  imaged  target  is  a  hand  placed  in  front  of  a  planar  background  ln.'ld  per¬ 
pendicular  to  the  world-:  axis.  The  range  sen.sor  is  looking  directly  at  the  hand  from  a 
distance  of  approximately  500  mm.  This  range  image  was  acquired  using  a  one  millisec¬ 
ond  stripe  scan.  Two  cxlendcil  lingers  and  two  loldcd  fingers  are  clearlv  visible.  F.acli  griti 
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Figure  17.  Rang«'  Image  (hand). 


point,  representing  measured  range  data  at  a  gi\  en  sensing  clement,  lies  on  the  3-D  line- 
of-sight  ray  which  passes  through  the  center  of  the  sensing  element  and  optical  center  ol 
the  sensor  lens.  Grid  point  spacing  becomes  denser  as  object  surface  closes  in  on  the  sen¬ 
sor.  Therefore,  smaller  "squares”  represent  object  surface  patches  closer  to  the  sensor  and 
may  make  the  object  shown  appear  to  be  a  "mold”  of  a  hand  at  lirst  glance.  Figure  18 
shows  the  pseudo-intensity  (retlectance)  image  acquired  at  the  same  time.  As  described  in 
Section  3.1.  this  image  is  the  peak-intensity  levels  recorded  by  sensing  cells  during  the 
stripe  scan. 

Fi^,ure  19  shows  a  "range  movie”  —  a  sequence  of  range  images  of  a  moving  hand. 
The  stripe  scan  time  and  the  interval  time  (time  between  frames)  were  850  microseconds 
and  15  msec,  respectively.  The  result  demonstrates  the  speed  with  which  the  sensm 
acquires  range  images. 


6.4.  Interdependence  of  Range  and  Intensity 

In  the  second-generation  sensor,  the  ranee  data  is  dependent  on  the  level  ol  rellected 
lieht  incident  on  the  sensing  cell,  fo  measure  how  intensity  and  range  data  are  interrelated, 
time-stamp  value  was  measured  with  changing  the  intensity  levels.  Figure  20  (a)  .md  ih) 
show  the  experimenttil  results  Irom  one  cell.  In  the  e.xperimental  setup,  a  planai  taiget  wa.s 
held  parallel  to  the  woi  Id-vv  plane.  The  projected  intensity  level  was  changed  by  putting  a 
neutral-density  filter  between  the  light  source  and  the  target,  fn  Figure  20.  the  time-stamp 
\alue  is  plotted  as  a  lunction  of  ihe  measured  intensity  \alue.  The  t.irget  was  iMaccLl  at  six 
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Figure  18.  Intensity  image  (hand). 

different  world-:  positions  where  the  intensity  level  was  varied  using  the  neutral  density 
filter  set  (transmittance  was  varied  in  a  20Cf  to  lOO^v  range),  The  horizontal  axis  repre¬ 
sents  the  digitized  intensity  value,  and  the  vertical  axis  shows  the  digitized  time-stamp 
value,  converted  to  range  using  previously  measured  calibration  parameters.  The  figures 
show  that  range  measurement  is  affected  by  the  intensity  level.  The  problem  is  exacer¬ 
bated  at  low  intensity  and  at  high  stripe  .scan  rates. 


This  phenomenon  is  caused  by  the  comparator  in  the  peak  detector  m  the  sensing  ele¬ 
ment  (see  .Section  3.1 ).  More  time  is  needed  to  decide  that  the  intensity  has  peaked  when 
the  peak  voltage  of  me  input  signal  is  low  due  to  insunicient  light.  We  attempted  to  com¬ 
pensate  lor  this  effect  by  correcting  range  mea.siirement  using  the  rcpoited  intensity  value 
From  ihe  cell.  However,  we  were  unable  to  obtain  an  adei|uate  model  lor  the  cllcct.  1  he 
mierrelation  of  range  and  intensity  differs  cell  by  cell  and  many  lactors  cause  mtensitv 
variation,  for  example,  the  scanning  speed  of  the  stripe,  the  distance  between  the  Imht 
source  and  the  object,  the  distance  between  the  object  anti  the  sensor.  Ihe  surlace  propei- 

ties  of  the  object. 


When  the  stripe  scan-time  is  reduced  to  6..^  msec,  the  iime-siamp  taluc  changes  In 
only  live  counls  of  the  12  bit  A/D  output  when  the  mtensitv  changes  frmii  .M)A  to  lOOA  , 
As  per  Ingiire  13.  ihis  corresponds  to  a  1.6  mm  difference  in  the  measuretl  range.  I■urthcr- 
more.  the  intensity  value  is  stable  as  shown  in  l-'igiire  16  and  can  be  used  as  .i  criterion  dur¬ 
ing  operation  lo  |mlec  the  conlidence  of  each  .ict|uircd  ranee  data  \aluc. 
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(1)1  =  0  msec 


(S)  I  =  105  msec 


( 10)  t  =135  msec 
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7.  Conclusion 


We  have  reviewed  the  design  and  implementation  of  a  very  high  speed  VLSI  range- 
image  sensor  and  have  presented  a  high  performance  range-imaging  system  based  on  the 
device.  This  system  acquires  a  32  x  32  range  image  in  a  few  milliseconds.  We  presented 
experimental  results  that  show  its  range  accuracy  to  be  less  than  one  millimeter  at  the  sys¬ 
tems  500  mm  maximum  operating  distance.  Repeatability  of  individual  range  measure¬ 
ments  was  within  0,5  mm.  The  cell-parallel  ranging  algorithm  employed  makes  the  spatial 
resolution  of  the  device  independent  of  the  range  image  acquisition  time. 


The  VLSI  ramie  sensor  has  demonstrated  a  successful  application  of  the  computational 
sensor  approach^in  which  processing  is  performed  locally  on  sensed  data.  Despite  the 
promise  of  the  computational  sensing  methodology,  few  practical  implementations  have 
been  reported.  The  work  reported  here  convincingly  demonstrates  the  power  ot  t  is 

approach. 
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Figure  A-l.  Ran^e-sensor  integrated  circuit  (lirst  generation). 


Appendix  A.  The  First-Generation  VLSI  Range  Sensor 


Our  tirst-gencrati(in  VLSI  ccll-parallcl  range  sensor  chip  is  shown  in  Ingure  AO.  This 
cle\  ice  consists  ol  X‘)P  sensing  elements  arrangetl  in  a  2S  ^  s2  array.  It  was  labricated  in  a 
2  LUn  p  well  (’\I()S  double  metal,  double  polv  process  atid  measures  d.2  mm  ■  7  d  tnm 
(w'tdth  heiiihti.  Ol  the  total  ^3  mm“  chip  area,  the  sensine  element  ariai\  lakes  up  .Xd 
mnr,  readout  column-select  circuiiiA  o  37  mnr,  and  the  output  integrator  0 Ob  mm"  The 
lemaimng  I4  trim"  is  used  lor  power  bussing,  signal  wiring  and  the  pad  sites. 

riie  architecture  chosen  lor  the  range  sensing  elements  is  shown  in  I  igure  ,\-2  .Areas 
ol' interest  m  the  duiiiram  include  the  photoreceptor  t PDiode i.  the  phoiocurreni  iraiisim- 
pedance  amplifier  iPhotoAmpi.  threshold  comparison  siaee  in2Compi.  stupe  event 
memoiA  iRS  Flopi,  time-stamp  Hack  aiul-hold  circuiliA  i PGatel /CCell  i  and  cell 
readout  loeic  i  PGateO /TokenCell  i 

In  operation,  setismg  elements  c\cle  between  two  phases  —  oi  and  n'dilmit 

Durim:  the  actjuisition  phase,  each  sensing  clement  implements  the  cell  paiallcl  procctiure 
ol  hieur:  4  The  pholodiotle  within  e.ich  cell  monitors  light  cncres  lellectcd  back  Irom  the 
scene,  [’hotoctirrent  outpttt  is  amphl'ied  and  contmuoiisK  compared  to  an  external  thresh, 
olil  \oltaec  When  photoreceptor  output  exceeds  this  ihicshold.  the  "stripe  detected 
latch  m  the  cell  is  inppcil.  holdme  the  value  ol  the  lime  si.mip  voltaec  ,il  that  msianl. 

I  he  acquisition  phase  is  s\nchroni/cd  with  stripe  motion  .md  ends  when  the  stripe 
completes  its  scan,  .\l  that  time,  the  sensing  elements  ol  the  ariax  have  leconlcd  a  range 
iinaee  in  the  lorm  ol  held  time  stamp  values.  The  raw  ranee  data  must  now  be  rcail  trom 
the  chip 

\  lime  mnllipicxed  rcailoni  sclicnic  oil  loads  die  .a  .iinicil  ranee  nii.iee  ai  .asici  oi,,ia: 
throiieh  a  sinele  chip  pm  I  lehl  lime  stamp  v  hai  ee  is  gtiied  oi/io  ,i  iw  o  lev  cl  analog  re.idout 
Alls  Msine  dual  n/[v  transisior  pass  jale  sinicluies  I  hcv  pcimil  the  iiso  ol  lail  to  rad  tunc 
siam[t  V  oliaecs,  max  i  in  i/ me  the  d\  namic  i  aiiec  ol  the  .inaloe  t  nnc  si  amp  data.  I  he  s  hai  ec 
IS  intceraled  on  chip  to  present  a  biittcied  output  voltaee  on  the  lime  stamp  lasicr  output 
pm 
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Appendix  B.  Sensor  Interface  Details 


The  chip  interface  consists  of  two  hoards  —  the  master  board,  which  controls  the  sys¬ 
tem  operation  and  communicates  with  the  host  computer,  and  the  slave  hoard,  which  con¬ 
tains  delicate  analog  circuitry.  The  entire  system  is  controlled  by  an  microcoded  engine 
implemented  on  the  master  board. 

B.l.  Circuitry  Overview 


Figure  B-1  and  Figure  B-2  outline  the  interface.  The  master  board  is  installed  in  the 
host  computer,  and  the  sensor  chip  and  its  optics  arc  mounted  on  the  slave  board.  Two  10- 
bit  half-duplex  parallel  bu.ses  connect  these  two  boards,  which  can  transfer  data  up  to  10 
megabytes  per  second  in  each  direction. 

Commands  issued  from  the  host  cause  execution  of  microcode  on  the  master  board 
(Figure  B-1).  The  microcode  is  held  in  memory  “uCode”  and  sequenced  via  program 
counter  “uCCnt”,  Vi.crocodc  memory  is  32  bits  wide.  The  upper  eight  bits  are  used  as  an 
input  for  a  system  clock  prescaler  (PSCnt),  used  to  change  the  sy.stcm  cycle  time  on  a 
clock  by  clock  ba.sis.  The  next  eight  bits  are  for  control  use,  such  as  selecting  an  internal 
register.  The  lower  twenty  bits  are  multiplexed  and  sent  to  the  slave  board  on  every  clock 
cycle.  Data,  such  as  range  data  or  intensity  data  read  from  the  sensor  chip,  appears  on 
receiving  buffers(RxDBuf ).  A  memory  (CellD)  is  provided  for  the  range  and  intensity 
data  storage  and  is  capable  of  storing  5 1 1  continuous  range  data  frames  or  255  pairs  of 
range/intensity  image  frames.  The  master  interface  uses  a  VME  bus  as  its  host  interface. 
Microcode  is  loaded  from  the  host  into  the  microcode  memory  and  the  acquired  range 
and/or  intensity  data  is  read  into  the  host  at  the  completion  of  a  measurement. 

Multiplexed  20-hit  data  arrives  at  receiving  buffer  (RxDBuf )  on  the  slave  board  ( Fig¬ 
ure  B-2).  The  lower  sixteen  bits  are  used  in  three  different  ways  —  as  specified  by  upper 
four  bits.  During  the  aequisition  phase,  the  data  .sent  is  the  time-stamp  ramp  signal  from  at 
RampBuf.  converted  to  a  voltage  by  the  12-bit  digital-lo-analog  converter  iReunpDAC). 
During  the.  readout  phase,  the  value  specifies  the  current  column  and  the  row  being  read. 

The  amplifiers  which  buffer  the  range  and  mtvmsity  data  have  variable  gain  and  olfset 
under  control  of  the  microcode  engine.  During  the  readout  phase,  range  and  intensity  data 
arc  digitized  using  the  aralog-to-digital  converters  'TSADC"  and  "lADC".  a\  conversion 
time  of  800  ns  is  required  so  the  output  bus  is  fast  enough  to  transfer  both  data  values  in 
time-multiplexed  fashion.  The  data  is  stored  in  buffer  “TADCBuf  or  "lADCBuf  after 
conversion  and  sent  out  to  the  master  board  through  the  transmitting  buffers  "TxDBuf". 


B.2.  Microcode  Format  and  Execution 

In  operation,  a  micro  instruction  is  read  from  die  microcode  memory  every  clock  cycle. 
As  shown  in  Figure  B-3.  each  instruction  consists  ol  three  fields  —  the  prcscalc  lielil 
i upper  eight  bits),  the  control  field  (next  eight  bits),  and  data  field  (lower  sixteen  bits).  The 
preseale  Held  is  loaded  into  the  system  clock  pre.scaler  and  deiermmes  the  execution  time 
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Figure  B-2.  Chip  interface  (slave  hoard) 
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Port  Select 
Write  operation 


[D17  D16] 

[D15] 

Write  Port 

Data  Field 

[0  0] 

[0] 

WrtBuf 

Row/Col  Select.  Gain/Offset  Set 

[1] 

Internal  Control  Port 

Control  Word 

[0  11 

RampBuf 

Time-Stamp  Value  (12-bit) 

[10] 

Not  Used 

[1  1] 

ETknBuf 

Start  A/D  Conversion 

Read  Operation 

[D19  D18] 

Read  Port 

[0  0] 

Not  Used 

[0  1] 

Miscin 

[10] 

Time-Stamp  A/D 

[1  1] 

Intensity  A/D 

Figure  B-3.  Microcode  format. 


of  the  next  instruction.  As  the  system  clock  is  16  megahertz,  the  presealed  execution  time 
is  calculated  as  follows  — 


7-,,=  X  (C,,+ I)  =  62..‘>«,VX(C,,+  I) 


where  C,,  is  the  value  of  prcscalc  Held  from  the  previous  instruction.  Pre.scaling  in  this 
way  provides  llexibility  to  efficiently  cope  with  quick  tasks  like  switching  gates  on  the 
chip,  as  well  as  relatively  slow  events,  like  an  analog-lo-digitul  conversion. 

The  control  field  describes  how  the  data  lield  should  be  interpreted  during  execution. 
The  lower  twenty  bits  of  each  instruction  arc  sent  to  the  slave  board  every  cycle.  Bits  D17 
and  D16  specify  which  of  the  three  hulfers  ’‘ReunpBuf”.  WrtBuf”  or  "ETknBuf"  are 
the  destination  of  the  data  field  (lower  sixteen  bits).  However,  if  all  three  bits.  D17.  D16 
and  D15,  are  asserted  data  is  not  latched  into  any  buffer  on  the  slave  board.  Rather,  the 
data  held  is  used  for  internal  control  on  the  master  board. 

The  slave  hoard  sends  twenty  bits  of  data  to  the  master  board  during  every  instruction. 
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Data 

Microcode  Mnemonic 

Function 

DO 

LUC_WAIT_SOS 

Wait  SOS 

D1 

luc_wait_eos 

Wait  EOS 

D2 

LUC_ENABLE_CNT 

ScanCnt  enable 

D3 

LUC_WRITE_CDATA 

Assert  CDMem  WE 

D4 

LUC_END_UCODE 

Assert  End_of_uCodc 

•  LUC_WA1T_S0S 

When  DO  is  asserted  in  microcode  execution,  the  program 
counter  (uCCnt  in  Figure  B-l.)  stops  counting  until  SOS 
signal  is  detected.  In  operation,  the  acquisition  phase  is  syn¬ 
chronized  with  the  stripe  scan  using  this  control, 

•  LUC_WAIT_EOS 

If  D1  is  asserted  in  execution,  uCCnt  is  stopped  until  EOS 
is  detected.  By  this  function,  readout  phase  waits  for  the 
stripe  sweep  completion, 

•  LUC_ENABLE_CNT 

D2  enables  ScanCnt  to  count  up  for  scan-time  measure¬ 
ment,  The  measurement  result  will  be  stored  in  Cel  ID  and 
read  by  the  host  afterward  for  .scan-time  correction  of  range 
measurement. 

•  LUC_WR1TE_CDATA 

If  D3  is  assorted  in  execution,  write-enable  pulse  to  the 
memory  (Cel ID)  is  generated.  Thus  range  data  sent  from 
the  slave  hoard  is  stored  in  the  memory. 

•  Ll'C_END_L'CODE 

If  D4  is  as.scrtcd  in  execution,  microcode  execution  will  be 
stopped  at  the  next  step.  The  host  can  know  the  state  of  the 
engine  by  reading  EouC  bit  in  StatBuf. 

•  luc_scnt_oe" 

If  D5  is  as.scrtcd  in  execution.  ScanCnt  output  is  enabled  at 
that  step. 

Table  B-l.  Control  word  mnemonic. 

The  bits  D19  and  D18  select  output  from  one  of  three  sources  “TADCBuf”,  “lADCBuf” 
or  “MiscInBuf 

The  function  of  data  field  changes  as  defined  by  the  control  held,  such  as  a  digital  time- 
stamp  ramp  signal  fed  to  a  D/A  converter,  or  an  encoded  row/column  select  signal,  or  a 
trigger  to  the  a\/D  converters.  This  held  is  also  used  ;o  control  execution  Ilow  in  the  master 
hoard.  The  special  meanings  assigned  to  each  bit  are  listed  in  Table  B-l, 
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Start_uCode 

SOS 

EOS 

ScanCnt 

Count_Enable 

uCCnt 

Count_Enable 

Wait_SOS 

Wait_EOS 

Ramp 


Figure  B-4.  Acquisition-phase  timing  diagram. 

B.3.  Control  Algorithm 

In  operation,  the  range-sensor  chip  cycles  between  the  acquisition  and  readout  phases 
(Section  3,2).  During  the  acquisition  pha.se.  range  is  recorded  and  held  as  a  time-stamp 
voltage  on  a  capacitor  in  each  sensing  cell.  After  the  stripe  has  swept  the  scene,  recorded 
data  is  read  out  immediately  in  the  readout  phase  that  tollows. 

B.3.1.  Acquisition  Phase 

The  host  triggers  the  microcoded  engine  by  asserting  the  “Start_uCode  bit  in  CmdBuf 
and  the  acquisition  phase  begins.  The  timing  diagram  is  drawn  in  Figure  B-4.  is  executed, 
which  pauses  the  system  until  the  SOS  signal  is  detected.  When  SOS  arrives,  the  micro¬ 
code  program  counter  and  the  scan-time  counter  (ScanCnt  t  are  started.  (The  scan-time 
counter  measures  the  duration  between  SOS  and  EOS  signal.)  Eacli  microcode  instruction 
now  updates  the  time-stamp  output  at  regular  intervals.  When  the  time-stamp  ramp  has 
completed,  LUC_WAIT_EOS  is  executed.  The  program  counter  is  paused  and  waits  for 
the  stripe  to  complete  the  .scan.  The  program  counter  starts  counting  when  EOS  is  detected 
and  ScanCnt  stops  counting.  If  EOS  is  seen  before  the  time-stamp  ramp  finishes,  the 
microprogram  continues  without  pausing  (ScanCnt  is  stopped  when  EOS  has  arrived). 


J 

^ ^  _ 


B.3.2.  Readout  Phase 

The  readout  phase  immediately  follows  the  acquisition  phase.  As  described  in  Section 
2.2,  .sensing  cells  are  addressed  for  readout  using  row  and  column  select  lines,  specified  by 
seven  bits  each  in  the  data  field  that  reads  them.  Circuitry  on  the  slave  board  (CSELPAL 
and  RSEL.PAL)  interprets  each  7-bits  '  alue  into  one  of  thirty-two  row  or  column  enable 
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System  Clock 
Column 


nnji;~Lj  ^URjmnjunn 


Integration 


Row 


I  Next  Row 


Data 


L 


Start  A/D 


End-of- 

Conversion 


Buf_OE 


Write  CellD 


Figure  B-5.  Readout-phase  timing  diagram. 


lines.  In  operation  (Figure  B-5).  the  column  to  be  read  is  first  enabled  to  precharge  that 
column’s  readout  path.  Then  cells  in  the  column  arc  read  in  tern  by  sequentially  enabling 
each  row.  After  all  cells  in  that  column  have  been  read,  the  next  column  is  enabled.  In  this 
manner,  the  entire  32  x  32  range  image  is  read  from  the  chip. 

For  each  cell,  an  integration  time  is  needed  before  to  charge  the  capacitor  in  the  output 
integration  circuit.  This  integration  time  is  adju.sted  by  using  the  presealing  function.  After 
enough  integration  time,  the  A/D  eonverters  arc  triggered  by  the  next  microcode  instruc¬ 
tion.  The  conversion  time  is  also  adju.sted  by  presealing  the  system  clock.  The  end-ot  ■  'U- 
version  signal  from  A/D  enables  the  ’‘TADCBuf”  and  ’’lADCBuf  ’  bulters  to  latch  the 
result.  After  conversion,  the  data  is  translerred  to  the  master  board  with  a  microinstruc¬ 
tion.  Three  stages  of  latches  arc  involveu  in  the  readout  operation  (i.e.  —  the  data  write 
command  “LUC_WR1TE_CDATA"  is  executed  three  instructions  after  the  corresponding 
readout  operation). 
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Appendix  C.  Pseudo-Inverse  Least-Squares  Fitting 


To  fit  an  «  X  1  observation  matrix  T  to  a  linear  model  of  p  parameters,  the  prediction  is 
written  as  — 


Y  =  XB  +  E 


where  X  is  an  n  x  p  variable  matrix,  Bispxl  parameter  matrix  whose  values  are  to  be 
approximated,  .  nd  E  represents  the  difference  between  the  actual  value  and  the  predie  • 
tion[7].  To  minimize  the  prediction  error,  defined  to  be  the  sum  of  the  elements  ot  L 
squared  (E^E),  differentiate  it  with  respect  to  B  and  set  to  0.  Fi^st,  e7 E  is  rewritten  as  fol¬ 
lows  — 

-  XB)^  {Y  -  XB) 

=  Y-B^X^  Y-B^X^  Y  +  B^X^XB 

=  Y^Y-IB^X^Y+B^X^XB 


By  differentiating  it  and  setting  the  derivative  to  0  — 

0  =  x^xb-x'y 

Thus  following  solution  is  obtained  — 

B  =  (X'X)~'x^K  =  x,,r 

where  Xp  is  called  the  pseudo-inverse  of  X. 


